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Large Supports are required for Well-Supported Nash Equilibria 
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Abstract 

We prove that for any constant k and any e < 1, there exist bimatrix win-lose games for which 
every e-WSNE requires supports of cardinality greater than k. To do this, we provide a graph- 
theoretic characterization of win-lose games that possess e-WSNE with constant cardinality 
supports. We then apply a result in additive number theory of Haight [S] to construct win-lose 
games that do not satisfy the requirements of the characterization. These constructions disprove 
graph theoretic conjectures of Daskalakis, Mehta and Papadimitriou [7] and Myers [T5] . 
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1 Introduction 

A Nash equilibrium of a bimatrix game (A, B) is a pair of strategies that are mutual best-responses. 
Nash equilibria always exist in a finite game [H], but finding one is hard, unless PPAD C P [5]. 
This has lead to the study of relaxations of the equilbrium concept. A notable example is an 
e-approximate Nash equilibrium (e-NE). Here, every player must receive an expected payoff within 
e of their best response payoff. Thus e-NE are numerical relaxations of Nash Equilibria. Counter¬ 
intuitively, however, given that Nash’s existence result is via a fixed point theorem, Nash equilibria 
are intrinsically combinatorial objects. In particular, the crux of the equilibrium problem is to find 
the supports of the equilibrium. In particular, at an equilibrium, the supports of both strategies 
consist only of best responses. This induces a combinatorial relaxation called an e-well supported 
approximate Nash equilibrium (e-WSNE). Now the content of the supports are restricted, but less 
stringently than in an exact Nash equilibrium. Specifically, both players can only place positive 
probability on strategies that have payoff within e of a pure best response. 

Observe that in an e-NE, no restriction is placed on the supports of the strategies. Consequently, 
a player might place probability on a strategy that is arbitrarily far from being a best response! This 
practical deficiency is forbidden under e-WSNE. Moreover, the inherent combinatorial structure of 
e-WSNE has been extremely useful in examining the hardness of finding Nash equilibria. Indeed, 
Daskalakis, Goldberg and Papadimitriou [6] introduced e-WSNE in proving the PPAD-completeness 
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of finding a Nash equilibrium in multiplayer games. They were subsequently used as the notion 
of approximate equilibrium by Chen, Deng and Teng [5] when examining the hardness of bimatrix 
games. 

This paper studies the (non)-existence of e-WSNE with small supports. Without loss of gener¬ 
ality, we may assume that all payoffs in {A,B) are in [0,1]. Interestingly, for e-NE, there is then 
a simple ^-NE with supports of cardinality at most two [7]. Take a row r. Let column c be a 
best response to r, and let r' be a best response to c. Suppose the row player places probability 
^ on r and r', and the column player plays column c as a pure strategy. It is easy to verify that 
this is a ^-NE. On the other hand, Althofer [1] showed the existence of zero-sum games for which 
every e-NE, with e < |, requires supports of cardinality at least logn. This result is almost tight; 
a probabilistic argument shows the existence of e-NE with supports of cardinality for any 

e > 0; see Lipton et al. HU. 

For the case of well-supported equilibria, Anbalagan et al. [2] recently showed the existence 
of win-lose games for which every e-WSNE, with e < |, require supports of cardinality at least 
y/\ogn. They also proved, in contrast to e-NE, that with supports of cardinality at most two, it is 
not possible to guarantee the existence of an e-WSNE, for any e < 1. 

The outstanding open problem in the area is whether there is a constant k and an e < 1 such 
that, for any bimatrix game, there is a e-WSNE with supports of cardinality at most k. In the 
paper we prove this is not the case. This result illustrates a fundamental structural distinction 
between e-WSNE and e-NE. This structural distinction also has practical implications with regards 
to behavioural models and popular equilibria search algorithms that focus upon small supports. 
The key to our result is the disproof of graph theoretic conjectures of Daskalakis, Mehta and 
Papadimitriou [7] and Myers [13] via an old result in additive number theory of Haight [S] . 

2 WSNE and a Graph Theoretic Conjecture 

A bimatrix game is a 2-player game with m x n payoff matrices A and B. We consider normal 
form games with entries in the payoff matrices in [0,1]. A pair of mixed strategies {p,q} forms an 
e-well supported Nash equilibrium (e-WSNE) if every pure strategy in the support of p (resp. q) is 
an e-approximate best response to q (resp p). Thus {p,q} forms an e-WSNE if and only if: 

\/i : Pi > 0 => ei^Aq > ej^Aq — e Vj = 1,.., m 

and 

yi : qi > 0 p^Bei > p^Bej — e Vj = 1,.., n 

To analyse well-supported equilibria in a win-lose game (A,B), Daskalakis et al. [7] applied a 
decorrelation transformation to obtain a pair of decorrelated matrices (A*,B*). The exact details 
of this decorrelation transformation are not important here. What is pertinent, however, is that the 
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n X n square 0 — 1 matrix A* induces a directed, possibly non-bipartite, graph H = (V,E). There 
are n vertices in V, and there is an arc ij G i? if an only if A*j = 1. Moreover, Daskalakis et ah 
proved that the original win-lose game has a (1 — ■^)-WSNE with supports of cardinality at most k 
if H contains either a directed cycle of length k or a set of k undominatecli] vertices. Furthermore, 
they conjectured that every directed graph contains either a small cycle or a small undominated 
set. 

Conjecture 2.1. ^ There are integers k and I such that every digraph either has a cycle of length 
at most k or an undominated set of I vertices. 

Indeed, they believed the conjecture was true for fc = / = 3 and, consequently, that every 
bimatrix win-lose game has a |-WSNE with supports of cardinality at most three. Interestingly, 
motivated by the classical Caccetta-Haggkvist conjecture [3] in extremal graph theory, a similar 
conjecture was made previously by Myers Ha- 

Conjecture 2.2. JWf There is an integer k such that every digraph either has a cycle of length at 
most k or an undominated set of two vertices. 

Myers conjectured that this was true even for k = 3, but Charbit [1] proved this special case to 
be false. 

We say that H is a {k,l)-digraph if every directed cycle in D has length at least k, and every 
S' C 1/ [D) of cardinality at most I is dominated. In Section [U we will prove that there exists a 
hnite {k, /)-digraph for every pair of positive integers k and 1. This will imply that Conjectures 12. II 
and 12.21 are false. 

3 A Characterization for Games with Small Support e-WSNE. 

In this section, we show Daskalakis et ah’s sufficiency condition extends to a characterization of 
when a win-lose game has e-WSNE with constant supports. To do this, rather than non-bipartite 
graphs, it is more natural for bimatrix games to work with bipartite graphs. In particular, any 
win-lose game {A, B) has a simple representation as a bipartite directed graph G = {RU C,E). 
To see this, let G contain a vertex for each row and a vertex for each column. There exists an arc 
(rj, Cj) G E if and only if Aij = 1. So r* is the best response for the row player against the strategy 
Cj of the column player. Similarly, there exists an arc {cj,ri) G E if and only if Bij = 1. So, Cj is a 
best response for the column player against the strategy r* of the row player. 

We will now show that a win-lose game has a (1 — ^)-WSNE with supports of cardinality at most 
k if and only if the corresponding directed bipartite graph has either a small cycle or a small set 
of undominated vertices. Thus we obtain a characterization of win-lose games that have e-WSNE 
with small cardinality supports. 

set S is undominated if there is no vertex v that has an arc to every vertex in S. 
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It what follows, we will only consider undominated sets that are contained either in ii or in C 

Lemma 3.1. Let G be a win-lose game with minimum out-degree at least one. If G contains 
an undominated set of cardinality k then there is a {1 — ^)-WSNE with supports of cardinality at 
most k. 

Proof. Without loss of generality, let U = {ri, ...,rk} be the undominated set. Let the row player 
play a uniform strategy p on these k rows. Since U is undominated, any column has expected 
payoff at most 1 — ^ against p. Therefore every column Cj is a (1 — ^)-approximate best response 
against p. 

By assumption, each row vertex r* has out-degree at least one. Let Cf(^i-j be an out-neighbour 
of Tj (possibly f{i) = f{j) for j / i). Now let the column player play a uniform strategy q on 
Because q has support cardinality at most k, each pure strategy r^ ^ U has an expected 
payoff at least ^ against q. Thus, these rfs are all (1 — |)-approximate best responses for the row 
player against q. So {p,q} is a (1 — ■|)-WSNE with supports of cardinality at most k. □ 

Lemma 3.2. If G contains a cycle of length 2k then there is a (1 — ^)-WSNE with supports of 
cardinality k. 

Proof. Let VL be a cycle of length 2k in G. Since G is bipartite, k of the vertices in the cycle are 
row vertices and k are column vertices. Let p be the uniform strategy on the rows in W and let q 
be the uniform strategy on the columns in W. We claim that p and q form a (1 — ■^)-WSNE. To 
prove this, consider the subgraph F induced by the vertices of W. Every vertex in F has out-degree 
(and in-degree) at least one since W C F. So, every pure strategy in p, gives the row player an 
expected payoff of at least ^ against q. Thus, every pure strategy in p is a (1 — ^)-best response 
for the row player against q. Similarly, every pure strategy in g is a (1 — ■^)-best response for the 
column player against p. □ 

Lemma l3.II and Lemma 13.21 immediately give the following corollary. 

Corollary 3.3. Let G be a win-lose game with minimum out-degree at least one. If G contains a 
cycle of length 2k or an undominated set of cardinality k then then the win-lose game has (1 — ^)- 
WSNF with supports of cardinality at most k. □ 

Importantly, the converse also holds. 

Lemma 3.4. Let G be a win-lose game with minimum out-degree at least one. If there is an e- 
WSNE (for any e <1) with supports of cardinality at most k then G either contains an undominated 
set of cardinality k or contains a cycle of length at most 2k. 

Proof. Take a win-lose game G = {RL)G,E) and let p and q be an e-WSNE. Suppose the supports 
of p and q, namely P Q R and Q G, have cardinality at most k. 
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We may assume that every set of cardinality every set of k (on the same side of the bipartition) 
is dominated; otherwise we are already done. In particular, both P and Q are dominated. Conse¬ 
quently, the row player has a best response with expected payoff 1 against q. Similarly, the column 
player has a best response with expected payoff 1 against p. Thus, for the e-WSNE {p, q}, we have: 

Vi : Pi > 0 ^ Rq > 1 — e > 0 

Vj : qj > 0 p^Cej > 1 — e > 0 

Here the strict inequalities follow because e < 1. Therefore, in the subgraph F induced by P U Q, 
every vertex has an out-degree at least one. But then F contains a cycle W. Since H contains at 
most 2k vertices, the cycle W has length at most 2k. □ 

Corollary 13.31 and Lemma 13.41 then give the following characterization for win-lose games with 
e-WSNE with small cardinality supports 

Theorem 3.5. Let G be a win-lose game with minimum out-degree at least one. Take any constant 
k and any e such that 1 — ^ < e < 1. The game contains an e-WSNE with supports of cardinality 

at most k if and only if G contains an undominated set of cardinality k or a cycle of length at most 

2k. □ 

4 Digraphs of Large Girth with every Small Subset Dominated 

In this section, we will first prove that there exists a finite {k, /)-digraph for every pair of positive 
integers k and I and, hence, disprove Coniecture l2.ll We then adapt the resulting counterexamples 
in order to apply Theorem 13.51 and deduce that, for any constant k and any e < 1, there exist 
bimatrix win-lose games for which every e-WSNE require supports of cardinality greater than k. 

The main tool we require is a result of Haight [5j from additive number theory. We will require 
the following notation. Let T be an additive group. Then, for X C T, denote 

X — X = {xi — X 2 I xi,X 2 G X}, and 

{k)X = {xi -\- X 2 Xk \ Xi ^ X ioi 1 < i < k}. 

Finally, let Zg = {0,1,..., g — 1} denote the additive group of Z/gZ, the integers modulo q. 
Haight [8] proved: 

Theorem 4.1. For all positive integers k and I, there exists a positive integer q = q{k,l) and 
a set X C Z^, such that X — X = Z^, but {k)X omits I consecutive residues. □ 

To construct the finite {k, /)-digraph we will use the following corollary. 

Corollary 4.2. For every positive integer k, there exists a positive integer q = q(k) and a set 
Y C Zq, such that Y — Y = "Lq, but 0 0 {k)Y. 
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Proof. Let I = k and apply Theorem 14.11 with q = q{k) = q{k,k). Thus, we obtain a set X C Zg 
with the properties that: {i) X — X = Zg, and (ii) {k)X omits k consecutive residues. But these 
k consecutive residues must contain ky for some y G Zg. Thus, there exists y € Zg such that 
ky 0 {k)X. 

Now, define Y := X — y. Then Y — Y = X — X = Zg. Furthermore, ky ^ {k){Y + y). This 
implies that 0 ^ {k)Y, as desired. □ 

We now construct a counter-example to Conjecture 12.21 of Myers. We will then show how the 
construction can be extend to disprove Conjecture 12.11 

Theorem 4.3. For any positive integer k, there exists a {K,2)-digraph D. 

Proof. Set k = (ac — 1)! and apply Corollary 14.21 Thus we find Y C Zg, with q = q{k) where 
Y — Y = Zg, and 0 0 ik)Y. From Y, we create a directed graph D as follows. Let the vertex set 
be V{D) = Zg. Let the arc set be E{D) = {ziZ 2 \ zi — Z 2 GY}. 

Now take any pair zi,Z 2 G Zg. Because Y — Y = Zg, there exist yi,y 2 &Y such that zi — Z 2 = 
2/1 — 2 / 2 - We now claim that the vertex pair ^ 1 , 2:2 € is dominated. To see this consider the 

vertex x G V{D) where x = zi + y 2 = Z 2 + 2/i- Then xzi is an arc in E{D) because x — zi = 
{zi + y 2 ) — zi = y 2 GY . On the other hand x = Z 2 + yi and so x — Z 2 = yi GY . Consequently, xz 2 
is also in E{D). Hence, every subset of V{D) of cardinality at most 2 is dominated. 

It remains to prove that D contains no directed cycle of length less than k. So, assume there 
is a cycle C with ordered vertices zi,Z 2 ,... ,Zs, where s < k. As ZiZi+i is an arc we have that 
Zi — Zj+i = yi where yi G Y, ioi 1 < i < s (here we assume Zs+i = zi). Summing around the cycle 
we have that 2/1 + 2/2 + • • • + 2/s = 0 modulo q. This implies that 0 G (sjT as yi,y 2 ,... ,ys € Y. 
Consequently, 0 G {ts)Y for any positive integer t. In particular, 0 G {k)Y = {{n — 1)!)T, as 
s < K — 1. This contradicts the choice of Y and, so, H is a (k, 2)-digraph, as desired. □ 

Theorem 4.4. For every pair of positive integers k and I, there exists a finite {k,l)-digraph. 

Proof. Without loss of generality, assume I > 2. By Theorem l4.3l there exists a ((/c —!)(/ —1) + 1, 2)- 
digraph D'. We claim that the {I — l)-st power of D' is a {k, Z)-digraph. More precisely, let the 
digraph D be defined by V{D) = V{D') and vw G E{D) if and only if there exists a directed walk 
from u to tc in D' using at most (I — 1) edges. 

Suppose D has a cycle of length at most k — 1. This corresponds to a closed directed walk of 
length a most {k — 1)(Z — 1) in D'. This is a contradiction as D' has no cycles of length shorter 
than {k — 1)(Z — 1) + 1. Therefore, the shortest directed cycle in D has length at least k. 

It remains to prove that every S CV(D) with 151 = I is dominated. So take S = {vi,V 2 , • • •, vi}. 
Recall that every pair of vertices in V{D') = V{D) is dominated in D'. So there is a vertex zi 
dominating v\ and V 2 in D'. Now let Zj+i be a vertex dominating Zi and Uj +2 for 1 < f < Z — 2. 
By construction, there is a directed walk in D' from zi-\ to Vi of length at most Z — 1, for every 
1 < Z < Z. Thus zi-iVi G E{D), and S is dominated in D, as desired. □ 
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Observe that these constructions are non-bipartite. To exploit the characterization of Theo¬ 
rem [33] (and therefore conclude that there are games with no e-WSNE with small supports), we 
desire bipartite constructions. These we can create using a simple mapping from non-bipartite to 
bipartite graphs. Given a non-bipartite graph G = {V,E), we build a win-lose game, that is, a 
bipartite directed graph G' = {RU G, E') as follows. We set R = G = V. Thus, for each Vi G V 
we have a row vertex ri G R and a column vertex q G G. Next, for each arc a = {vi,Vj) in G, we 
create two arcs (rj,Cj) and {ci,rj) in G'. Finally, for each Vi gV we add an arc (rj,Cj). 

Now let’s understand what this mapping does to cycles and undominated sets. First, suppose 
G contains a cycle of length k. Then observe that G' contains a cycle of length k it k is even and 
of length /c -|- 1 if fc is odd. On the other hand, suppose the minimum length cycle in GMs A; -|- 1. 
This cycle will contain at most one pair of vertices type {r*, q}, and if it contains such a pair then 
these vertices are consecutive on the cycle. (Otherwise we can find a shorter cycle in G'.) Thus, G 
contains a cycle of length A: or A: -|- 1. 

Second, consider an undominated set S' C F of size i in G. Then S G R is undominated in G'. 
(Note S G G may be dominated because we added arcs of the form {ri,Ci) to G'). On the other 
hand if S is undominated in G' (either in R or C) then S is also undominated in G. 

Applying this mapping to a non-bipartite {2k + 1, A:)-digraph produces a bipartite digraph for 
which every set of k vertices (on the same side of the bipartition) is dominated but that has no 
cycle of length at most 2k. Thus, by Theorem 13.51 the corresponding game has no e-WSNF, for 
any e < 1, with supports of cardinality at most k. 

Theorem 4.5. For any constant k and any e < 1, there exist bimatrix win-lose games for which 
every e-WSNE requires supports of cardinality greater than k. □ 

References 

[1] I. Althofer, “On sparse approximations to randomized strategies and convex combinations”. 
Linear Algebra and its Applications^ 199, pp339-355, 1994. 

[2] Y. Anbalagan, S. Norin, R. Savani and A. Vetta, “Polylogarithmic supports are required for 
approximate well-supported Nash equilibria below 2/3”, Proceedings of Ninth Conference on 
Web and Internet Economics (WINE), ppl5-23, 2013. 

[3] L. Caccetta and R. Haggkvist, “On minimal digraphs with given girth”, Congressus Numer- 
antium, 21, ppl81-187, 1978. 

[4] P. Charbit, “Circuits in graphs and digraphs via embeddings”. Doctoral Thesis, University of 
Lyon, 2005. 

[5] X. Chen, X. Deng, and S. Teng, “Settling the complexity of computing two-player Nash equi¬ 
libria”, Journal of the ACM, 56(3), ppl-57, 2009. 


7 


[6] C. Daskalakis, P. Goldberg, and C. Papadimitriou, “The complexity of computing a Nash 
equilibrium”, SIAM Journal on Computing, 39(1), ppl95-259, 2009. 

[7] C. Daskalakis, A. Mehta, and C. Papadimitriou, “A note on approximate Nash equilibria”. 
Theoretical Computer Science, 410(17), ppl581-1588, 2009. 

[8] J. Haight, “Difference covers which have small fc-sums for any k", Mathematika, 20, ppl09-118, 
1973. 

[9] J. Fearnley, P. Goldberg, R. Savani, and T. Sprensen, “Approximate well-supported Nash 
equilibria below two-thirds”. Proceedings of Fifth International Symposium on Algorithmic 
Came Theory (SAGT), ppl08-119, 2012. 

[10] S. Kontogiannis and P. Spirakis, “Well supported approximate equilibria in bimatrix games”, 
Algorithmica, 57, pp653-667, 2010. 

[11] R. Lipton, E. Markakis, and A. Mehta, “Playing large games using simple startegies”. Pro¬ 
ceedings of Fourth Conference on Electronic Commerce (EC), pp36-41, 2003. 

[12] R. Lipton and N. Young, “Simple strategies for zero-sum games with applications to complexity 
theory”. Proceedings of Twenty-Sixth Symposium on Theory of Computing (STOC), pp734- 
740, 1994. 

[13] J. Myers, “Extremal theory of graph minors and directed graphs”, Doctoral Thesis, University 
of Gambridge, 2003. 

[14] J. Nash, “Non-cooperative games”. Annals of Mathematics, Vol 54, 289-295, 1951. 



